| Source | # of sentences | Average logarithmic rank |
|---|---|---|
| https://www.aajtak.in/india/news/story/parliament-budget-session-2022-live-rahul-gandhi-first-to-speak-on-motion-of-thanks-to-president-in-lok-sabha-ntc-1404130-2022-02-02?utm_source=rssfeed | 11 | 4.29 |
| https://www.aajtak.in/world/story/russia-ukraine-crises-troop-withdrawal-world-war-nato-ntc-1413025-2022-02-17?utm_source=rssfeed | 12 | 4.29 |
| https://www.aajtak.in/crime/news/story/moradabad-girl-live-in-relationship-on-rent-partner-refused-to-marry-then-committed-suicide-lcla-1582740-2022-11-24?utm_source=rssfeed | 11 | 4.35 |
| https://www.aajtak.in/world/story/india-and-pakistan-are-taking-same-diplomatic-way-on-russia-ukraine-war-tlifw-1420065-2022-03-01?utm_source=rssfeed | 12 | 4.37 |
| https://www.aajtak.in/entertainment/television/story/tunisha-sharma-death-case-remand-copy-submitted-by-police-against-sheezan-khan-tmovb-1604333-2022-12-28?utm_source=rssfeed | 11 | 4.38 |
| https://www.aajtak.in/world/story/pakistan-pm-imran-khan-address-to-the-nation-10-big-highlights-ahead-of-no-trust-voting-ntc-1443093-2022-04-09?utm_source=rssfeed | 15 | 4.44 |
| https://navbharattimes.indiatimes.com/metro/delhi/other-news/delhi-schools-to-reopen-restrictions-related-to-corona-will-be-removed-decision-to-be-taken-in-ddma-meeting/articleshow/89142619.cms | 12 | 4.45 |
| https://www.aajtak.in/india/news/story/assembly-election-results-2022-live-updates-up-punjab-uttarakhand-goa-manipur-vidhan-sabha-chunav-parinam-news-in-hindi-tspo-1426019-2022-03-10?utm_source=rssfeed | 14 | 4.45 |
| https://www.aajtak.in/world/story/imran-khan-pakistan-firing-shocking-detail-injure-ntc-1567822-2022-11-03?utm_source=rssfeed | 15 | 4.45 |
| https://www.dailyhindinews.com/2022/05/16/within-7-days-of-marriage-the-young-man-hanged-himself/ | 11 | 4.45 |
| https://www.dailyhindinews.com/2022/03/10/10-special-points-of-pm-modis-address-on-bjps-thumping-victory-from-family-corruption-to-lok-sabha-elections-2024%e0%a4%aa%e0%a4%b0%e0%a4%bf%e0%a4%b5%e0%a4%be%e0%a4%b0%e0%a4%b5%e0%a4%be%e0%a4%a6/ | 11 | 4.46 |
| https://www.aajtak.in/crime/police-and-intelligence/story/nawab-malik-arrest-bjp-resignation-case-detail-uddhav-thackeray-ntc-1416826-2022-02-23?utm_source=rssfeed | 17 | 4.47 |
| https://www.aajtak.in/india/maharashtra/story/maharashtra-rain-uttrakhand-flood-meteorological-department-ntc-1493441-2022-07-04?utm_source=rssfeed | 11 | 4.47 |
| https://dailyhindinews.com/21-year-old-youth-died-after-falling-on-the-heart-attack-stage-while-playing-garba/ | 11 | 4.48 |
| https://navbharattimes.indiatimes.com/india/india-china-face-off-along-lac-time-to-give-ultimatum-1993-and-1996-agreement/articleshow/96179401.cms | 15 | 4.48 |
| https://www.aajtak.in/explained/story/coronavirus-new-variant-omicron-sub-variant-xbb-xbb1-severity-all-you-need-to-know-ntc-1558603-2022-10-18?utm_source=rssfeed | 12 | 4.48 |
| https://www.aajtak.in/crime/news/story/kaushambi-man-killed-his-live-in-partner-and-threw-her-body-into-river-lclt-1554394-2022-10-12?utm_source=rssfeed | 11 | 4.49 |
| https://www.aajtak.in/health/story/mohali-mms-issue-how-to-overcome-if-you-are-the-victim-of-such-cyber-crime-1540319-2022-09-19?utm_source=rssfeed | 11 | 4.49 |
| https://www.aajtak.in/india/politics/story/rajasthan-cm-ashok-gehlot-exclusive-interview-reaction-on-becoming-congress-president-ntc-1524542-2022-08-24?utm_source=rssfeed | 12 | 4.49 |
| https://www.aajtak.in/world/story/russia-ukraine-war-13th-day-live-news-updates-vladimir-putin-zelensky-joe-biden-ntc-1423958-2022-03-08?utm_source=rssfeed | 12 | 4.49 |
| https://www.aajtak.in/india/politics/story/by-election-six-state-bjp-congress-uttar-pradesh-maharashtra-ntc-1567387-2022-11-02?utm_source=rssfeed | 12 | 4.50 |
| https://navbharattimes.indiatimes.com/india/not-interested-in-pm-or-cm-tejashwi-yadav-will-lead-bihar-cm-nitish-kumar-big-hint-before-lok-sabha-election/articleshow/96199032.cms | 13 | 4.51 |
| https://www.aajtak.in/rajasthan/story/wife-lover-kills-husband-over-extramarital-affairs-illicit-relation-bharatpur-rajasthan-lclar-1580224-2022-11-21?utm_source=rssfeed | 11 | 4.52 |
| https://www.dailyhindinews.com/2022/08/21/ghulam-nabi-withdraws-from-anand-sharmas-resignation-why-congress-is-getting-shocks-on-setbacks/ | 11 | 4.52 |
| https://www.aajtak.in/crime/news/story/sonali-phogat-death-news-police-fir-murder-case-sonali-death-sudhir-sangwan-sukhwinder-wasi-accused-ntc-1525499-2022-08-26?utm_source=rssfeed | 17 | 4.53 |
| https://www.aajtak.in/india/news/story/per-gb-internet-data-cost-in-india-internet-users-rural-urban-statistics-ntc-1493294-2022-07-05?utm_source=rssfeed | 12 | 4.53 |
| https://www.aajtak.in/india/politics/story/punjab-pm-narendra-modi-security-lapse-gave-bjp-big-political-issues-assembly-elections-political-benefits-ntc-1388186-2022-01-07?utm_source=rssfeed | 12 | 4.53 |
| https://www.aajtak.in/business/utility/story/if-your-salary-double-every-7-years-career-growth-is-positive-salary-hike-ratio-tuta-1585074-2022-11-28?utm_source=rssfeed | 15 | 4.54 |
| https://www.aajtak.in/world/story/coronavirus-in-china-three-covid-waves-in-china-omicron-ba52-bf7-symptoms-all-you-need-to-know-ntc-1598267-2022-12-20?utm_source=rssfeed | 13 | 4.54 |
| https://www.aajtak.in/world/story/russia-ukraine-war-sixth-day-live-news-update-vladimir-putin-joe-biden-zelensky-pm-modi-ntc-1419844-2022-03-01?utm_source=rssfeed | 12 | 4.54 |
| Source | # of sentences | Average logarithmic rank |
|---|---|---|
| https://www.aajtak.in/religion/rashiphal/story/arthik-rashifal-16-august-2022-tuesday-aaj-ka-financial-horoscope-in-hindi-tlifd-1518963-2022-08-16?utm_source=rssfeed | 11 | 6.96 |
| https://navbharattimes.indiatimes.com/good-news/scientist-who-is-giving-100-success-formula-to-farmers-writes-amrood-chalisa-aam-lichi-dohawali/articleshow/96277806.cms | 51 | 6.93 |
| https://navbharattimes.indiatimes.com/business/railway/railways-has-announced-many-special-trains-for-diwali-chhath/articleshow/94653599.cms | 16 | 6.80 |
| https://www.aajtak.in/religion/rashiphal/story/daily-horoscope-dainik-rashifal-11-october-2022-tuesday-tlifdm-1553686-2022-10-11?utm_source=rssfeed | 29 | 6.78 |
| https://www.aajtak.in/religion/rashiphal/photo/daily-horoscope-dainik-rashifal-thursday-20-january-2022-astrology-tlifd-1395842-2022-01-20?utm_source=rssfeed | 12 | 6.72 |
| https://www.aajtak.in/religion/rashiphal/story/daily-horoscope-dainik-rashifal-8-december-2022-thursday-tlifdn-1590874-2022-12-08?utm_source=rssfeed | 11 | 6.68 |
| https://www.aajtak.in/religion/rashiphal/story/daily-horoscope-dainik-rashifal-21-september-2022-wednesday-tlifdm-1541422-2022-09-21?utm_source=rssfeed | 14 | 6.64 |
| https://www.aajtak.in/religion/rashiphal/photo/daily-horoscope-dainik-rashifal-friday-22-july-2022-astrology-tlifd-1503908-2022-07-22?utm_source=rssfeed | 11 | 6.63 |
| https://www.aajtak.in/religion/rashiphal/story/daily-horoscope-dainik-rashifal-13-september-2022-tuesday-tlifd-1536358-2022-09-13?utm_source=rssfeed | 13 | 6.58 |
| https://www.dailyhindinews.com/2022/03/01/mp-21-lakh-lamps-will-be-lit-in-the-city-of-mahakaleshwar-this-evening-will-become-a-world-record/ | 15 | 6.58 |
| https://pratahkal.com/yug-antak-baikunth-shukl/ | 11 | 6.54 |
| https://www.aajtak.in/religion/rashiphal/photo/aaj-ka-rashifal-18-march-2022-holi-today-horoscope-in-hindi-12-zodiac-signs-tlifd-1430506-2022-03-18?utm_source=rssfeed | 13 | 6.54 |
| https://www.aajtak.in/religion/rashiphal/story/daily-horoscope-dainik-rashifal-24-september-2022-saturday-tlifdm-1543444-2022-09-24?utm_source=rssfeed | 23 | 6.52 |
| https://www.aajtak.in/religion/rashiphal/story/daily-horoscope-dainik-rashifal-7-december-2022-wednesday-tlifdm-1590179-2022-12-07?utm_source=rssfeed | 24 | 6.50 |
| https://www.dailyhindinews.com/2022/03/21/todays-horoscope-21-march-2022/ | 12 | 6.50 |
| https://www.aajtak.in/entertainment/television/story/kbc-14-live-updates-in-hindi-kaun-banega-crorepati-14-amitabh-bachchan-news-sony-liv-app-tmovk-1520194-2022-08-17?utm_source=rssfeed | 11 | 6.48 |
| https://www.aajtak.in/religion/rashiphal/photo/weekly-rashifal-saptahik-rashifal-predictions-21-march-to-27-march-for-each-zodiac-sign-tlifd-1431572-2022-03-20?utm_source=rssfeed | 13 | 6.43 |
| https://www.aajtak.in/religion/festivals/story/holi-2022-date-18-march-friday-timings-rangwali-holi-lucky-colours-muhurat-katha-tlifd-1429927-2022-03-17?utm_source=rssfeed | 11 | 6.42 |
| https://www.aajtak.in/religion/rashiphal/photo/aaj-ka-rashifal-3-april-2022-today-horoscope-in-hindi-12-zodiac-signs-tlifd-1439519-2022-04-03?utm_source=rssfeed | 11 | 6.42 |
| https://www.dailyhindinews.com/2022/03/06/todays-horoscope-06-march-2022/ | 11 | 6.42 |
| https://www.aajtak.in/religion/rashiphal/story/daily-horoscope-dainik-rashifal-8-november-2022-tuesday-chandra-grahan-lunar-eclipse-2022-tlifdm-1570802-2022-11-08?utm_source=rssfeed | 16 | 6.41 |
| https://www.aajtak.in/religion/rashiphal/story/daily-horoscope-dainik-rashifal-30-september-2022-friday-lalita-panchami-2022-tlifdn-1547026-2022-09-30?utm_source=rssfeed | 12 | 6.40 |
| https://www.aajtak.in/religion/rashiphal/story/arthik-rashifal-24-august-2022-wednesday-aaj-ka-financial-horoscope-in-hindi-tlifd-1523954-2022-08-24?utm_source=rssfeed | 11 | 6.38 |
| https://www.aajtak.in/india/gujarat/story/cm-bhupendra-patel-including-4-engineers-3-lawyers-ministers-in-gujarat-cabinet-know-from-which-district-ntc-1593552-2022-12-12?utm_source=rssfeed | 11 | 6.36 |
| https://www.aajtak.in/religion/rashiphal/photo/daily-horoscope-dainik-rashifal-sunday-2-january-2022-astrology-tlifd-1384886-2022-01-02?utm_source=rssfeed | 12 | 6.35 |
| https://www.aajtak.in/religion/rashiphal/photo/daily-horoscope-dainik-rashifal-8-september-2022-thursday-tlifd-1533372-2022-09-08?utm_source=rssfeed | 13 | 6.34 |
| https://www.aajtak.in/religion/rashiphal/story/money-financial-horoscope-19-january-2022-aaj-ka-arthik-rashifal-in-hindi-tlifd-1395006-2022-01-19?utm_source=rssfeed | 39 | 6.34 |
| https://www.aajtak.in/entertainment/bollywood-news/story/bhool-bhulaiyaa-2-trailer-release-kartik-aaryan-kiara-advani-tabu-tmov-1452902-2022-04-26?utm_source=rssfeed | 12 | 6.33 |
| https://www.aajtak.in/religion/rashiphal/story/daily-horoscope-dainik-rashifal-22-december-2022-thursday-tlifdm-1599670-2022-12-22?utm_source=rssfeed | 21 | 6.33 |
| https://www.aajtak.in/india/news/story/china-give-chengdu-j10ce-fighter-jet-to-pakistan-what-will-be-effect-on-indian-defence-tstrd-1576019-2022-11-15?utm_source=rssfeed | 15 | 6.32 |
In this subsection we replace average word length by average logarithmic word rank. The logarithm of the word rank is taken because we want to punish words of high ranks only moderately.
First table:
select source, count(distinct i_s.s_id) as cnt_s, round(avg(log(w.w_id-100)),2) as av from sources so, inv_so i_s, inv_w i, words w where so.so_id=i_s.so_id and i_s.s_id=i.s_id and i.w_id=w.w_id and w.w_id>100 group by source having cnt_s>10 order by av LIMIT 30;
6.4.2.1 Average word length for different sources
6.4.2.3 Sources consisting of many / few words with frequency 1
6.4.2.4 Sources with low / high average word length of rare words